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Abstract 

' As established by R T. Rockafellar, real valued convex-concave functions are generically diflerentiable. 

r-|- ' It this paper we shall show that for a convex-concave function defined on an open convex set C x D, there 

. , exist dense subsets M oi C and of D such that the partial derivative with respect to the first variable 

i-S^ ' (resp. second variable) exists on A/" x D (resp. C x A1) and therefore the function is differentiable on 

I M y. M. This is an interesting property of convex-concave functions and it does not hold for convex- 

convex functions. As an immediate application we recover the generic single-valuedness of monotone 
operators. 

> ■ 1 Introduction 
(N 

■ Many results about generic differentiability of real valued convex functions are already known. However, 

to our knowledge the only results about directional derivatives and generic differentiability of real-valued 
convex-concave function was established by R T. Rockafellar in [5]. Since then there has been some con- 
tributions and extensions to the continuity and differentiability of convex-concave and biconvex operators 
taking vales in appropriate partially ordered vector spaces (see [HIS] and references therein). 

The regularity properties of convex-concave functions follows indeed as extensions of similar results for 
. ^ ^ convex functions. That is why one may not expect to obtain a better result when it comes to convex-concave 

' functions. Here is our main theorem that reveals an interesting property of convex-concave functions. 

' Theorem 1.1 Let H he a convex- concave function on R" x R'". Let C x D be an open convex set on which 

H is finite. The following statements hold, 

(1) There exists a dense subset Af of C , such that C^{C \ M) — and for each x e A/", the partial derivative 
Vi-ff (x, y) exists for all y G D. 

(2) There exists a dense subset Ai of D such that C™'{D\M) = and for each y E Ai the partial derivative 
V2H{x, y) exists for all x £ C. 

(3) The complement of M x M in C x D has Lebesgue measure zero in R" x R™ and H is differentiable on 
the dense subset M x M of C x D. 

The above conclusion no longer holds for convex-convex functions, for instance the function _ff : R x R — > R 
defined by H{x, y) = \x — y\ fails to have this property. In fact, for each dense subset AA of R, the partial 
derivative with respect to the first variable does not exist on the whole set A/" x R. 

Here is an immediate corollary of this Theorem to skew-symmetric functions, i.e. functions define on R" x R" 
with H[x,y) — —H{y,x) for all (x, y) 6 Dom[H). 
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Corollary 1.2 Let H be a convex- concave skew- symmetric function on R" x R". Let C x C be an open 
convex set on which H is finite. There exists a dense subset Af of C , such that C"'{C\Af) = and for each 
X G A/", the function H is differentiable at {x,x). 

An important application of this Corollary is the generic single- valuedness of monotone operators. Indeed, 
as shown by E. Krauss [B] one can associate to each maximal monotone operator T : R" M", a skew- 
symmetric closed convex-concave function Ht such that 

Tx — y if and only if (y, —y) G dHT{x, x), 

where dHr stands for sub-differential of convex-concave function introduced by T. R. Rockafellar. By the 
above Corollary Ht is almost every where differentiable on the diagonal of Dom(T) x Dom{T) (assuming 
int{Dom{T)) ^ 0) and therefore dHT{x,x) = VHt{x,x) for a dense subset of Dom{T) for which we have 
the operator T is almost everywhere single- valued. For a detailed proof in more general spaces, the interested 
reader is referred to [7 where a new and shorter proof of the Krauss result together with the extension of 
Theorem II. II to mappings on Asplund topological spaces are provided. 

The proof of Theorem 1 1 . II consist s of permanence properties of convex-concave functions established by T. R. 
Rockafellar [5] together with a fundamental but less-known result of Arzela [3 [2] in (1883/1884) providing a 
necessary and sufhcient condition for the point wise limit of a sequence of real valued continuous functions 
on compact sets to be continuous (see Theorem 13.41 in the present paper for the statement). 

In the next section we recall some preliminary definitions and results which will be of use in section 3 where 
Theorem 1 1.1 1 is proved. 



2 Preliminaries 

In this section we start by introducing the notations used throughout the paper and then recall some of the 
standard results for both convex and convex-concave functions. 



As to notation: If a;, y e M" then the inner product is denoted by {x, y)Rn. Explicitly if x = (xi, Xn) and 

y = {yi,-;yn) 

{x, y)R« = Xiyi -\- ..-\- Xnyn- 

The norm of a; is ||x|| — (x, x). Lebesgue measure in i?" will be denoted by £" and integrals with respect 
to this measure will be written as / f{x)dx. Let / : R" — > (— oo,-foo] be any function. Let x be a point 
where / is finite. The directional derivative of / at x in the direction u is denoted by Df{x)u and is defined 
to be 

r^r, ^ ,. f{x + Xu) - f{x) 
Df[x)u— Imi ; 

if it exists. If / is differentiable at x, the directional derivatives Df{x)u are all finite and 

Df{x)u^{Vf{x),u)^,., VueR", 

where V/(x) is the gradient of / at x. 

Let us list some of the properties of directional derivatives of convex functions. 

Theorem 2.1 Let f : R" (— cxd, -I-oo] be a proper convex function. Let x be a point where f is finite. The 
following statements hold, 

(1) For each u G R", the difference quotient in the definition of Df{x)u is a non- decreasing function of 
A > 0, so that Df(x)u exists and 

Df{x)u^M /(^ + ^^)-/(^) . (1) 

(2) Df{x)u is a positively homogeneous convex function of u, with 

Df{x)u + Df{x){-u)>0 VueR". 
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Definition 2.2 Say that a mapping H : R" x M™ — ?• [— C)o,cxd] is a saddle function provided it is convex in 
the first variable and concave in the second; more precisely, we require that the function x H[x,y) (resp. 
y — )■ —H{x, y)) be a convex function for each fixed y G K™ (respectively each x G IR™/ 

Similarly, one can define the directional derivatives for a saddle function H : M" x M™ [— oo, cx)] as follows 
Let (a;, y) G M" x M™ be a point where H is finite. The one sided directional derivative of H at (a;, y) in the 
direction (m, v) G M" x M™ is defined to be the limit 

H{x + \u,y + \v)-H{x,y) 
UH[x,y)[u,v) — lim 

A-i.O+ A 

if the limit exists. By Theorem 12.11 the directional derivatives 

r, rjf ,• Hix + Xu,y) - H{x,y) 
DiH(x,y)(u) ^ hm 

A-i-0+ A 

and 

n ET/ N/ N r H{x,y + \v) - H{x,y) 
D2H{x,y)(v) ^ hm 

A^0+ A 

exist and if H is differentiable with respect to the first variable (resp. second variable) at {x, y) then 

D^H{x, y){u) = (Vii7(x, y), u)^. {resp. D^Hix, y){v) = (V2i/(x, y), v)^^) 

for all u G M" (resp. v G R™) where ViH{x, y) (resp. V2H{x, y)) is the gradient of H with respect to the 
first variable (resp. second variable) at {x,y). This result is due to T. Rockafellar [8]. 

Theorem 2.3 Let H be a convex- concave function on R" x R™. Let C x D be an open convex set on which 
H is finite. Then for each {x,y) G C x D, DH(x,y){u,v) exists and is a finite positively homogeneous 
convex- concave function of (u, v) on K" x R™. In fact, 

DH{x, y){u, v) = DiH{x, y){u) + D2H{x, y){v). 

3 Proof of Theorem 11.11 

Fix {x,y) E C X D. For each A > 0, define the following functions on 

H{x + Au, y + Xv) — H{x, y) 



n „ mm 



Hx(u,v) 



Hx{u,v) = 



A 

H{x + Xu, y + Xv) — H{x, y + Aw) 



A 

H\[u) = H\{u,Q) and H^{v) = H\{0,v). We have the following result regarding the convergence of 
Hx,Hx,Hl and 

Proposition 3.1 The following statements hold. 

(1) H\(u) converge uniformly to DiH{x,y){u) on compact subsets o/R". 

(2) H\{v) converge uniformly to D2H{x,y){v) on compact subsets o/R™. 

(3) H\{u,v) converges uniformly to DiH{x,y){u) -\- D2H{x,y){v) on compact subsets Ax B o/R" x R™. 

(4) Let u G R^. IfViH{x,y) exists then for each v G R", 

lim DiH(x,y -\- Xv)(u) = DiH(x,y)(u), 
and this convergence is uniform on compact subsets o/R™. 

(5) H\{u,v) converges uniformly to DiH{x,y){u) on compact subsets Ax B ofW^ x R™. 
We shall need the following result known as Dini's theorem for the proof of this Proposition. 
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Theorem 3.1 Let K be a compact subset in a metric space, and 

(1) {/fe} is a sequence of continuous functions on K, 

(2) {/fc} converges pointwise to a continuous function f on K, 

(3) fk{x) > fk+i{x) for aUxeK,k^ 1, 2, 3, .... 

Then fk f uniformly on K and therefore f is continuous on K. 

Proof of Proposition [37ll For parts (1) and (2), note that is a non-decreasing function and is a 
non-increasing function of A > and therefore the result follows from Dini's Theorem. 

Proof of part (3): We first show that for each e > there exists Aq > such that for all < A < Ao, we have 
Hx{u,v) < DiH{x,y){u) + D2H{x,y){v) + e, for all {u,v) e Ax B. 

Then by a dual argument we have 

H\{u, v) > DiH{x, y){u) + D2H{x, y){v) - e, for all {u, v) e A x B, 

from which we obtain the desired result in part (3). The difference quotient in the function H\ can be 
expressed as 

H{x, y + Xv) — H{x, y) H{x + Am, y + Xv) — H{x, y + Xv) 
A ^ A ' 

where the first quotient converges uniformly to D2H{x, y){v) on B. It follows from Theorem 35.1 in [5] that 
H is Lipschitz on every closed bounded set oi C x D. Suppose A > is the Lipschitz constant on the set 

K := {(x + SiA) X iy + S2B);0< 61,62 < 60} 

where > is small enough so that K C C x D. Since H\{u) converges uniformly to DiH{x, y)(u) on A, 
there exists < a < i5o such that 

H{x + au,y)~ H{x,y) ^ „ u ^ , ^ 

< DiH(x,y)(u) + -. 

a 2 

Thus, for every v £ B and < A < (5o, it follows from the above inequality that 

H{x + au,y + Xv)-H{x,y + Xv) ^ ^ „, w ^ , « 2AA||w|| 

< DiH{x, y)[u) + - + . 

a la 

Let Ao be small enough such that ^'^"^^^"^^ < e/2 for all v e B. For each < A < min{Ao, a} we have 

H{x + an, y + Xv) — H{x, y + Xv) 



DiH{x,y){u) + e > 



a 



^ H{x + Xu,y + Xv) - H{x, y + Xv) 
X 

from which part (3) follows. 

We know prove part (4). Note first that by ^ in TheoremOwe have "(^+^^'V+^^^-"(^-y+^^) > DiH{x, y+ 
Xv){u), from which together with ^ we have 

DiH{x, y){u) + e > DiH{x, y + Xv){u), (3) 

for every < A < min{Ao, a} and v £ B. By a similar argument we have 

- DiH{x, y){-u) - e < -DiH{x, y + Xv){-u), (4) 

It follows from (O, dJ) and part (2) of Theorem [2T] that 

-DiH{x, y){-u) - e < -DiH{x, y + Xv){-u) < DiH{x, y + Xv){u) < DiH{x, y){u) + e, 

and the result follows due to assumption that \7iH{x,y) exists and DiH{x,y){u) — —DiH{x,y){—u) = 
{\7iH{x,y),u)M^^. 

Part (5) follows from the fact that H\{u,v) — Hx{u,v) — H^{v). □ 
The following result holds for both convex-concave and convex-convex functions. 
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Proposition 3.2 Suppose F is a finite convex- concave (resp. convex- convex) function on convex subset 
C X D o/M" X M™. The following assertions hold: 

(1) There exists a dense subset J\f of C, such that C"{C \Af) — and for each x e J\f, the partial derivative 
\7iH{x,y) exists for almost all y E D. 

(2) There exists a dense subset A4 of D such that C"^{D\Ai) = and for each y E Ai the partial derivative 
V2H{x,y) exists for almost all x G C. 

Proof. We just prove part (1). Part (2) follows from a similar argument. For each a; G C, set 

Nx = {y E D; \7iH{x, y) does not exist }. 

Thus, the set N ~ Ux^c{x} x consists of all (x, y) E C x D such that \i'iH{x, y) does not exist. It follows 
that for convex-concave (resp. convex-convex) functions this set is of measure zero in R" x W"\ Therefore, 
it follows from Fubini's theorem that 

= [[ dydx= [ [ l^x}xN^dydx= [ C^{Nx)dx. 
JJ JcJd Jc 

N 

Therefore, there exists a dense subset TV of C, such that £"(C \ A/") = 0, and for each x E Af one has 
J^"^{Nx) = from which one has D \ Nx is dense in _D. □ 

Lemma 3.2 Let TV and A4 be as in Provosition \3.2\ for the convex-concave function H in Theorem \1.1\ 
The following statements hold. 

(1) Let xq E Af. For each u E M" the function : Z? — S> M defined by fu{y) = DiH{xQ,y){u) is continuous. 

(2) Let yo E Ai. For each v E M™ the function : C — !■ K defined by gv{x) — D2H{x, yo){v) is continuous. 

Note that the functions /„ and gy in the above Lemma are indeed the pointwise limit -not necessary uniform 
though- of the quotients in the definition of directional derivatives of the function H. To prove the continuity 
of these functions we first recall the notion of quasi-uniformly convergence and an immediate application 
introduced by Arzela [1] . 

Definition 3.3 A sequence {fk} of (scalar-valued) functions on an arbitrary set X is said to converge to 
f quasi-uniformly on X, if {fk} converges pointwise to f and if, for every e > and L E N, there exists a 
finite number of indices fci, ^2, fc; > L such that for each x E X at least one of the following inequalities 
holds: 

<e, i = l,2,...,Z. 

Theorem 3.4 If a sequence of real-valued functions on a topological space X converges to a concinnous limit, 
then the convergence is quasi-uniform on every compact subset of X. Conversely, if the sequence converges 
quasi-uniformly on a subset of X , the limit is continuous on this subset. 

The interested reader is also referred to a more recent paper [3] for the proof. 

Proof of Lemma 13.21 We just prove part (1). A similar argument yields part (2). Let i? be a compact 
subset of D with a non-empty interior. Fix u E M". We shall show that y — t- fu{y) = DiH{xo,y){u) is 
continuous on i3. In order to simplify the writing and since the direction u is fixed, we do not indicate the 
dependence of the function /„ to u and we just use / instead of /„. 
Note first that f{y) = DiH{xo,y){u) = limfe^oo fk{y) where 

H{xo -\- XkU,y) ~ H{xo,y) 
fk[y) = ' 

and Xk = 1/fc for fc G N. Note that for each k the function fk is continuous. We shall show that fk converges 
quasi-uniformly to / on B. Fix e > and L E N. Since Xq G TV, it follows from Proposition 13.21 that there 
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exists a dense subset B^g of D such that \/iH{xo,y) exists for all y G Bx„- For each y G B^g, it follows from 
parts (4) and (5) of Proposition [Ol that there exists ky > L such that 



H{xo + XkyU,y + XkyV)-H{xo,y + XkyV) 

y DiH{xo,y){u) 



e 

<2' 



and 

\DiH{xo,y + \kyV){u) ~ DiH{xo,y){u)\ < -, 

for every v e B. Note that /fe„(y + Afc^w) = [H{xo + Xk^u.y + Xk^v) - H{xo,y + Xk^v)]/ Xky and f{y + Xk^v) = 
DiH{xo,y + XkyV){u). Thus, it follows from the above inequalities that 

\fkyiy + XkyV)^fiy + XkyV)\<e, (5) 

for all V € B. Define Uy = {y + XkyV; v G B}. Since B^g is dense in D we have 

B C Uj,eij,„mi(t^y)- 

_B is compact and therefore there exist yi,2/2, ■••,2/; G i?xo such that B G U-^jint(f7j^.). This together with 
([S]) implies that 

\fky, (w) - f{w)\ < e, for aU w G f/^,, 
and therefore fk converges to / quasi-uniformly on B from which we have / is continuous on B. □ 

Proof of Theorem 11.11 Let J\f and Ai be as in Lemma [3.21 Fix xq G J\f. We shall show that \/iH{xQ,y) 
exists for all y G -D. It follows from Proposition l3.2l there exists a dense subset Bxg of D such that Vii?(xo, y) 
exists for all y G B^g ■ Fix u G . We need to show that 

DiH{xo, y){u) + DiH{xo, y){~u) - 0, (6) 

for all y ^ D. Note first that, equality (|6]) holds for all y G B^g- It also follows from Lemma [3.21 that the 
function y — >■ DiH{xo, y){u) + DiH{xo, y){—u) is continuous and therefore the result follows from the density 
of Bxg in D. 

By a similar argument we have that for every yo ^ Ai, V2-ff(x, t/o) exists for all x G C. It finally follows that 
M X M is dense in C x D and for each (xq, yo) & M x M, the function H is differentiable at {xo,yo)- O 
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